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ABSTRACT 


An  application  of  control  theory  to  an  administrative 
problem  is  given  for  the  case  of  a system  of  stored  items 
which  are  periodically  reworked  to  improve  their  relia- 
bility. Expressions  are  developed  for  the  final  value  of 
the  reliability  when  the  system  is  stable  and  the  limits 
of  stability  are  found.  A Kalman  filter  is  used  in  the 
control  model  to  obtain  an  estimation  of  the  item  relia- 
bility when  there  are  random  errors  in  the  measurement  and 
in  the  rework  process.  An  extension  is  done  for  more  than 
one  dimension  for  systems  composed  of  subsystems  in  series 
parallel  or  a combination  of  both.  A procedure  for  an 
optimal  sequence  of  levels  of  rework  is  found  in  the  sense 
of  optimizing  a linear  combination  of  several  performance 
measures.  Numerical  examples  are  presented  to  demonstrate 
the  use  of  the  several  expressions. 
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Such  a system  might  include  a stock  of  ordnance  which 


is  acquired,  stored,  and  periodically  reworked,  but  not 
expended  except  for  war  time  use,  or  alternatively  expended 
in  training  with  replacement  by  new  items. 

On  the  other  hand,  items  such  as  big  missiles  are  not 
likely  to  be  expended,  and  thus  expenditure  and  replacement 
cannot  be  considered  as  a control  variable  for  the  relia- 
bility. Thus,  unless  due  to  other  factors,  the  expenditure 
of  such  items  would  be  avoided  in  favor  of  rework  of  the 
items . 

In  this  thesis  we  will  study  only  the  case  where  there 
is  no  expenditure  and  replacement,  leaving  reliability  over 
time  to  be  maintained  by  rework.  We  will  also  consider 
the  case  where  we  have  several  levels  of  rework  and  want 
to  find  the  optimal  sequence  of  levels  over  successive 
reworks  in  order  to  optimise  a given  performance  measure. 

A general  rework  model  is  developed  in  Chapter  II 
which  relates  the  reliability  of  an  item  following  rework 
to  its  reliability  following  the  last  rework.  .An  equiva- 
lent model  is  also  developed  relating  the  reliabilities 
of  an  item  immediately  before  consecutive  reworks.  These 
models  may  be  solved  for  any  rework  cycle  given  the  initial 
reliability  at  acquisition. 

In  Chapter  III  the  concepts  of  control  theory  are 
reviewed  and  applications  to  control  of  the  reliability  of 


li 

* 

•i 

(j 


items  in  inventory  are  suggested  and  structured. 


Whan  we  have  random  errors  in  our  measure  of  the  item 


reliability  or  when  the  rework  process  introduces  random- 
ness in  the  item  reliability,  then  we  have  to  make  our 
judgments  based  on  estimated  values.  In  Chapter  IV,  a 
Kalman  Filter  is  used  with  our  control  model  to  accomplish 
this  estimation.  An  examination  of  the  final  value  and  the 
stability  of  our  system  is  followed  by  an  extension  to 
more  than  one  dimension  for  the  case  where  we  have  systems 
composed  of  several  subsystems  in  series,  parallel  or  a 
combination  of  both. 

In  Chapter  V we  shall  extend  our  work  to  the  case  where 
we  can  decide  among  several  levels  of  rework.  Using  dynamic 
programming,  we  will  shew  how  to  derive  the  optimal  rework 
policy  for  this  case  in  accordance  with  several  performance 
measures,  namely,  to  obtain  a desired  reliability,  to  mini- 
mire the  costs  of  several  reworks,  to  minimize  the  time 
to  achieve  a desired  reliability,  or  to  satisfy  a combina- 
tion of  all  these  performance  criteria.  Conclusions  and 
recommendations  for  further  study  are  offered  in  Chapter  VI. 
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II.  DEVELOPMENT  OF  THE  REWORK  MODEL 


In  this  chapter  the  general  rework  model  is  developed 
which  will  relate  either  the  reliability  of  an  item  follow- 
ing a rework  or  the  reliability  of  an  item  immediately 
before  a rework  to  the  same  reliability  for  the  last  rework 
and  the  effectiveness  of  the  rework  process.  A solution 
is  found  for  these  two  reliabilities  at  any  instant  given 
the  initial  or  acquisition  reliability-  of  the  item. 

„ THE  EFFECTIVENESS  OF  REWORK 

One  form  of  rework  mechanism  would  raise  an  item's 
reliability  to  a certain  level  which  is  independent  of  the 

I 

item's  reliability  prior  to  rework,  as  might  be  the  case 
when  components  or  parts  are  replaced.  Another  way, 
developed  by  Sohannan  [2]  and  adopted  in  this  thesis,  is 

I 

for  the  rework  mechanism  to  achieve  an  increase  in  relia- 

I 

bility  which  is  proportional  to  both  the  item  unreliability 
before  rework  and  the  effectiveness  of  the  rework  mechanism. 

\\ 

blies  or  subassemblies  are  tested  and  repaired  rather  than 
replaced.  Denoting  the  item  reliability  immediately  before 
the  rework  by  R,  the  reliability  following  the  rework  by 

R_,  we  can  define  the  effectiveness  of  the  rework  process 

3 . ! 


a as 


The  interpretation  of  the  rework  effectiveness  a is  that 
the  greater  its  value,  the  more  effective  the  rework  pro- 
cess or  in  other  words  the  item  unreliability,  1-R,  will 
be  reduced  by  an  amount  proportional  to  a since  from 
Equation  (1)  we  can  write 

1 - Rg  = (1-R)  - a (1-R) . 

Under  these  circumstances,  it  may  be  possible  for  such  a 
rework  mechanism  to  improve  the  item  reliability  to  where 
it  is  "better  than  new",  "as  good  as  new"  or  "not  as  good 
as  new".  Because  of  deterioration  of  reliability  during 
storage,  we  note  that  in  this  last  case,  the  reliability 
might  continue  to  decrease  until  the  items  need  to  be 
replaced,  rather  than  reworked. 

B.  THE  REWORK  MODEL 

From  the  definition  of  effectiveness  of  the  rework 
process  , given  by  expression  (1),  the  reliability  of 
an  item  following  the  rework,  Rg,  is 

Ra  - R + a ( 1-R) , 


or 


R 3 (l-a)R  a 
s 


(2) 
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Let  R ( t)  represent  the  reliability  of  an  item  of  age  t 
when  there  is  no  rework.  We  assume  that  all  failures  are 


random,  suggesting  (i)  that  there  are  no  early  failures  or 
that  some  form  of  "burn  in"  has  been  used  to  eliminate 
early  age  failures,  and  (ii)  that  because  the  items  are 
in  storage  and  not  in  an  operating  environment,  either 
there  are  no  wearout  failures  or  the  time  to  occurrence  of 
wearout  is  much  longer  than  the  projected  time  until  the 
next  scheduled  rework.  Thus  assuming  that  the  reliability 
R(t)  is  an  exponential  function, 


for  t > 0.  Since  the  initial  reliability  R , for  t = 0, 
— * o 

is 


R =»  R ( 0 ) = e 

o 


we  have 


R(t)  = RQ  e~bt  (4) 

for  t >_  0 and  b > 0.  The  value  of  the  parameter  b depends 
on  the  nature  of  the  item  stored  and  on  the  storage  environ- 
ment. 

If  the  system  contains  N items,  which  are  reworked  at 
a constant  rate  a,  then  the  period  T to  "turn  over"  the 
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inventory  is 


N 

P 


We  begin  by  looking  at  new  items  that  are  going  to  be 

reworked  for  the  first  time.  The  duration  of  the  rework 

process  is  T/N  and  the  "age"  of  a new  item  selected  for 

rework  under  a First  In,  First  Out  (FIFO)  policy  will  thus 
T 

be  T - and  its  reliability  R immediately  prior  to  its 
first  rework  will  be 


R(T-£) 


= Ro  e 


-b(T-£) 


(5) 


If  the  item  is  going  to  be  periodically  reworked,  we 

can  rewrite  the  above  equation  for  the  reliability  just 

prior  to  the  (k+l)st  rework.  This  will  occur  at  time 
T 

t = (k+DT-rr,  and  we  have 
N 

T -b(T-|) 

R(kT  + T - ±)  = R (kT)  e w 

N S 


When  k = 0 in  this  equation,  we  get 


T -k(T-i) 

R(T-i)  = Rg(0)  e 


and  from  Equation  (5)  we  have  then 


Rq  = Rs(0)  , 
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are  used  to  label  the  branches,  and  indicate  that  a multi- 


or  in  other  words  the  initial  or  acquisition  reliability 

i.  u 

may  be  considered  as  the  "reliability  following  the  0 

rework",  or  as  the  initial  value  for  the  reliability 

following  the  rework,  R Ik) . Evidently  there  is  no  rework 

s 

at  the  time  of  acquisition  and  this  equivalence  is  used 
only  for  purpose  of  coherence.  The  reliability  just  prior 
to  the  first  rework  is  then  only  defined  for  values  of  k 
equal  to  or  greater  than  one. 

The  process  is  presented  schematically  in  Figure  1. 
Assuming  that  N or  the  rework  rate  are  relatively  large, 

T - £ 3s  T and 


RlkT-t-T)  = Rs(kT)  e . 

For  simplicity  we  will  denote  R(kT)  by  R(k) , and  the 
reliability  immediately  before  the  iktl)st  rework,  R(k+1), 
can  then  be  rewritten  as  a function  of  the  reliability 
following  the  kth  rework  R (k) : 

R(k+1)  ” Rs(k)  e'bT  (6) 

This  expresses  the  reliability  of  an  item  immediately 
before  the  ik*-l)th  rework  recursively,  as  an  exponential 
function  with  initial  value  Rg(kT)  which  is  the  reliability 
of  the  item  at  the  beginning  of  the  kth  period. 

Rewriting  expression  for  the  reliability  following 

a rework  with  this  notation,  we  have 


13 


Turn  over  period  T 
« — — — — 


— I (— 

R(k)  Rg(k) 


i T.'N  > 

— I i ►time 

Rlk+1)  Rgik+U 


Rework  Till*? 


FIGURE  1.  Reliabilities  during  the  kth  period 
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states  that  the  transfer  function  from  input  u to  a response 


(1-a)  R(k)  + a . 


(7) 


Rs(k)  - 

Combining  the  above  equations,  we  have  the  expression 
for  the  reliability  after  the  (k+l)th  rework  in  terms  of 
the  reliability  after  the  kth  rework, 

Rg  (k+1)  =■  (1-a)  Rg  (k)e~bT  + a,  k =■  0,1,2,  ... 

(8) 

We  may  also  write  the  reliability  immediately  before 
the  (k+l)th  rework  in  terms  of  the  reliability  just  prior 
to  the  kth  rework, 

R (k+1)  =■  R(k)e“bT  + a (l-R(k)  )e“bT,  k = i,2,...  (9) 

When  using  this  equation  we  have  to  consider  as  initial 

condition  the  reliability  immediately  before  the  first 

-bT 

rework,  R(l)  * R e 
o 

C.  THE  SOLUTION  TO  THE  REWORK  MODEL 

Equations  (8)  and  (9)  are  first  order  difference  equa- 
tions, and  we  can  solve  them  by  using  the  z transform  tech- 
nique, described  in  Appendix  A,  with  the  advantage  that  we 
will  obtain  a closed  form  solution  instead  of  a solution 
in  the  form  of  summation. 

In  Appendix  A we  show  that  taking  the  z transform  of 
both  sides  of  equation  (8) , we  get 
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zR_  (z)  - zR  = ( 1-ct)  R (z)  e"bT  + - az-.  , (10) 

S O s Z " 1 


where  R_(z)  means  the  z transform  of  R (k) . 
s s 


Rearranged,  this  gives 


(z-  (l-a)e  bT)Rs(z)  = zRQ  + ^ , 


Rs(z)  = 5 IbT  Ro  + a~~  -&T 

z - (1-a)  e Di  ° (z-(l-a)  Di)(z-1) 


which  when  expanded  in  partial  fractions  yields 


o l7)  - s R + _z a + 2 

su;  “ , -bT  o z-1  . ,,  ' -bT  , . -bT, 

z-(l-a)e  l-(l-a)e  [z-(l-a)e  ] 


[ (1-a) e-bT-l] 


The  solution  of  this  equation  is  obtained  by  taking 
its  inverse  z transformed,  as  developed  in  Appendix  A, 
yielding 


- x , , > k -bkT„  a 

R (k)  = (1-a)  e R 

s ° (1-a) e Di-1 


,,  ..  . k -bkT. 

[l-(l-a)  e ] 


Using  the  same  method  for  Equation  (9) , we  take  the 
z transform  to  get 


-bT  -bT  z 

zR ( z ) - zR(l)  = (l-a)e  R(z)+ae  , 


P 


or 


[z-(l-a)e“bT]R(z)  = zR ( 1)  + --b-  , 2 . 

z-l 


Solving  for  R(z) , we  get 


Tbf Rd)  + TbT- 

z-e  Di  (1-a)  (z-l)  [z-(l-a)e  br] 


which  expanded  in  partial  fractions  yields 


— =e! R(i)  +t£t> 

z-e  D (1-a) 


[1- (1-a) e bT] 


z ae~bir[(l-a)e~bT] 

[z-(l-a)e“bTl  [ (l-a)e“bT-l] 


Taking  the  inverse  z transform,  we  find  the  solution  in  the 
time  domain  to  be 


R (k)  = (l-a)ke"bkTR(l) — p= — [1- (1-a)  ke"bkT] 

(1-a) e-D  -1 


Equation  (13)  gives  the  reliability  of  an  item  immediately 
before  the  rework  at  time  t = kT  for  a given  initial  con- 
dition R ( 1) , the  reliability  of  the  item  just  before  the 
first  rework.  Equation  (11)  gives  the  reliability  of  the 
item  after  the  rework  at  time  t = kT  for  a given  initial 
condition  RQ,  the  reliability  of  the  item  at  the  time  of 


. J ii 


acquisition.  Comparing  these  two  equations  we  notice  that 

-bT 

they  are  different  only  by  a factor  of  e , as  might  have 
been  expected  from  the  Expression  (6)  that  relates  these 
two  reliabilities. 

As  an  example,  values  of  Rg(k)  and  R(k)  are  shown  in 

Table  (I)  for  various  values  of  Rq,  a,  b and  T.  As  can  be 

seen  in  Table  I,  for  T = 400  and  R * 0.8  we  have,  for 

o 

a * 0.8,  the  case  "not  as  good  as  new";  for  a = 0.569  the 
case  "as  good  as  new”;  and  for  a = 0.7,  an  improvement  of 
item  reliability  constituting  the  "better  than  new"  case. 

The  value  of  a that  leads  to  the  case  "as  good  as  new"  can 
be  found  by  setting  the  reliability  following  the  first 
rework  R (1)  equal  to  the  initial  reliability  R . Thus 

o O 

from  equation  (11)  we  have 

Rs(l)  = (l-a)e"bTR(0) --_bT — ( 1-  ( 1-a)  e~bT]  = R(0), 

(l-a)e  -1 

which,  rearranged,  gives 

— hT 

a = [1  - ( 1-a) e Di]  R(0) 

or 

-bT  -bT 

a - aR ( 0 ) e 0i  = R(0)  (1-e  ) . 

Solving  for  a yields 
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TABLE  I 


Examples  of  reliability  immediately  before  rework 
R(k)  and  reliability  following  rework  Rslk). 
Initial  reliability  - R 
Rework  Effectiveness  » 

Deterioration  parameter  = b 
Turnover  period  » T 


R - 0.8  T - 400 

o 


a » 

0.2 

a ■ 

0.569 

a “ 

0.7 

k 

Rlk) 

Vk) 

R(k) 

Rslk) 

Rlk) 

Rslk) 

1 

0.536 

0.629 

0.536 

0.300 

0.536 

0.8bl 

2 

0.422 

0.537 

0.536 

0.800 

0.577 

0.873 

3 

0,360 

0.488 

0.536 

0.300 

0.585 

0.876 

4 

0,327 

0.462 

0.536 

0.800 

0.587 

0.876 

R - 0. 
o 

3 

a - 0.7 

T 

=*  50 

T - 

100 

T - 

250 

k 

ROc) 

R.(k) 

s 

Rlk) 

R Ik) 
s 

Rlk) 

R Ik) 
s 

1 

0.761 

0.928 

0.724 

0.917 

0.623 

0.38“ 

2 

0.383 

0.965 

0.830 

0.949 

0.691 

0.907 

3 

0.918 

0.975 

0.359 

0.953 

O.'Ol 

0.912 

4 

0.928 

0.978 

0.366 

0.960 

0.710 

0.913 

R,  - 0. 
o 

95 

T - 100 

a 

- 0.07 

a 1 

- 0.8 

a » 

0.9 

k 

R(k) 

R„  ik) 

s 

Rlk) 

Rsvk) 

Rlk) 

Rslk) 

1 

0.860 

0.958 

0.360 

0.972 

0.360 

0.986 

2 

0.867 

0.960 

0.979 

0.976 

0.392 

0.989 

3 

0.869 

0.961 

0.383 

0.977 

0.395 

0.990 

4 

0.869 

0.961 

0.384 

0.977 

0.895 

0.990 

b * 0.001  for  all  cases 


control  the  system  makes  the  system  non  linear,  involving 
equations  that  are  time  variant.  This  can  be  solved  by 
another  area  of  the  control  theory  which  while  not  covered 
in  this  thesis,  can  be  done  in  a further  work. 

In  this  chapter  we  derived  a rework  model  for  the  case 
when  we  have  a constant  rework  rate.  We  solved  our  dis- 
crete recursive  equations  for  the  reliability  before  the 
rework,  R(k) , and  after  the  rework,  Rs(k),  by  the  z trans- 
form technique.  The  result  is  in  a closed  form  rather  than 
in  the  form  of  a summation,  making  this  solution  more  suit- 
able for  further  analysis  as  will  be  done  in  Chapter  IV. 
Before  this  analysis,  we  will  first  derive  in  the  next 
chapter  this  same  closed  form  solution  by  applying  the 
control  theory  approach. 


III.  DEVELOPMENT  OF  THE  CONTROL  MODEL 


In  Chapter  II  we  developed  the  rework  model  and  found 
the  system  of  first  order  difference  equations  relating 
the  reliability  immediately  before  the  rework  R(k)  to  the 
reliability  after  the  rework  Rg(k): 


R (k+1) 


Rs(k)  e 


-bT 


(15) 


and 


Rs(k)  = a ( 1-R (k) ) + R (k)  . 


(16) 


We  then  solved  this  system  using  the  z transform  technique, 
obtaining  an  expression  for  the  reliability  after  any 
rework  as  a function  of  the  initial  reliability,  Rq, 


Rg(k)  = 


(l-ct)VbkTRo  - 


(l-a)e~bT-l 


,,  . k -bkT, 

(1- (1-a)  e ] , 


(17) 


and  an  expression  for  the  reliability  immediately  before  any 
rework  as  a function  of  this  reliability  before  the  first 
rework : 


R(k) 


(l-a)VbkTR(l)  - 


-bT 


-dT 

( 1-a) e -1 


r,  ,k  -bkT. 

[l-(l-a)  e ] 


(18) 
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The  response  of  the  system,  Y(z),  can  be  now  obtained 


In  this  chapter  we  will  introduce  a control  theory 
approach  to  the  rework  problem,  and  then  derive  these  same 
expressions  in  terms  of  control  theory.  This  will  provide 
a basis  for  later  solving  the  problem  of  obtaining  an 
optimal  sequence  of  rework  levels. 

A.  THE  CONTROL  THEORY  APPROACH 

In  this  section  we  will  review,  in  a simplified  form, 
the  main  aspects  of  control  theory  that  are  of  interest 
to  our  rework  model. 

The  first  fundamental  concept  underlying  a control 
system  is  that  of  a dynamic  mode  1 , that  is  a model  des- 
cribing the  relationships  among  the  relevant  variables  and 
parameters  of  our  system.  In  the  model,  the  variables  are 
allowed  to  change  with  time  in  a deterministic  way,  and 
the  system  behavior  depends  not  only  on  their  values  at  any 
instant,  but  also  on  their  past  values  and  the  rate  of 
change  of  these  variables  with  time.  The  equations  derived 
in  Chapter  II  constitutes  such  a dynamic  model  of  our  system. 

The  second  fundamental  concept  we  will  need  is  that  cf 
a closed-loop  control  system,  i.e.,  one  in  which  the  output 
has  a direct  effect  upon  the  control  action,  as  shown 
schematically  in  Figure  2.  The  output  and  the  reference 
input  are  compared  in  the  controller  and  we  say  that  the 
output  is  fed  back  to  the  controller.  The  difference  between 
the  reference  signal  and  the  feedback  signal,  called  the 
error  signal  or  input  signal  to  the  plant,  is  then  used  to 

23 


This  is  the  same 


as  Mia 


change  the  behavior  of  our  plant  or  process  with  the  goal 
of  bringing  the  output  of  the  system  to  a value  that  gives 
a zero  error. 

The  "plant"  is  any  physical  or  abstract  object  to  be 
controlled.  Sometimes  we  feedback  a measure  of  our  output: 
for  this  case,  a box  representing  the  measurement  device 
would  be  drawn  in  the  feedback  branch  of  the  block  diagram 
of  Figure  2.  In  summary,  the  term  "closed  loop"  implies 
the  use  of  feedback  action  in  order  to  reduce  system  error. 

An  open  loop  control  system  is  a control  system  in  which 
the  output  has  no  effect  upon  the  control  action,  that  is, 
the  output  is  neither  measured  nor  fed  back  for  comparison 
with  the  reference.  An  advantage  of  the  closed-loop  control 
system  is  that  the  use  of  feedback  makes  the  system  output 
relatively  insensitive  to  external  disturbances  and  internal 
variations  in  system  parameters,  since  a correction  action 
is  taken  anytime  the  error  is  not  zero. 

An  useful  tool  in  control  theory  is  a signal  flow  graph . 
This  is  a pictorial  representation  of  a set  of  simultaneous 
algebraic  equations  in  which  each  variable  is  represented 
by  a graphical  symbol  called  a node,  and  the  dependencies 
between  pairs  of  variables  are  represented  by  directed 
branches  drawn  between  pairs  of  nodes.  These  dependencies 
between  two  variables  are  called  transfer  functions,  or 
gains  and  are  defined  as  the  ratio  of  the  incoming  variable 
to  the  variable  at  the  end  of  the  branch.  Transfer  functions 


are  used  to  label  the  branches,  and  indicate  that  a multi- 
plication operation  is  done  upon  the  value  entering  the 
branch  in  the  arrow  direction,  delivering  a new  branch  value 
to  the  node  where  the  branches  terminates . The  nodes  are 
also  summing  devices  which  sum  all  values  arriving  by  the 
way  of  incoming  branches.  As  an  example  of  this.  Figure  3 
shows  the  signal  flow  graph  for  a hypothetical  system 
defined  by  the  set  of  equations 


x^  = bx2  + dx4  + fu 


x2  = axl 


x = ix_  + ex  + gu 


x . = cx, 

4 3 


Y = hx, 


Given  the  signal  flow  graph  of  a system  we  often  wish 
to  write  the  overall  transfer  function  from  an  input  or 
reference  value  to  the  output.  This  can  be  obtained 
directly  from  the  signal  flow  graph  by  inspection  or  by 
use  of  Mason's  Theorem.  This  theorem,  which  we  will  use 
later,  expresses  the  transfer  function  in  terms  of  various 
loop  gains  and  the  parallel  gains  from  input  to  output,  and 


14 


states  that  the  transfer  function  from  input  u to  a response 
Y is 


Y 

U 


V P . A • 

v i i 


where  the  terms  are  defined  as: 

(1)  A is  the  determinant  of  the  feedback  configuration 
and  is  calculated  from  the  equation 

A * 1 - f L'  + F ' L.L,  - F • L L L + ...  , 

j **  k 4 *■  mno 

where  the  L.  (or  L.  , etc.)  are  loop  gains  all  the  way 
1 K 

around  a feedback  loop  in  the  system.  Thus  means  the 

sum  of  all  loop  gains.  The  next  term  J 1 L^L^,  is  the  sum 

of  all  products  of  pairs  of  different  loop  gains  - e.g., 

and  so  forth.  The  prime  on  the  summation  means  we  use 

only  the  products  for  pairs  of  gains  of  non-touching  loops. 

In  other  words,  is  included  only  if  loop  1 does  not 

touch  loop  3 (two  loops  touch  if  they  have  at  least  one 

node  in  common).  Likewise,  ^ ' L L L is  the  sum  of  all 

‘ mno 

products  three  at  a time,  where  again  each  of  the  three 
loops  does  not  touch  the  other  two. 

(2)  is  a path  gain  of  the  ith  forward  path  from 
input  U to  output  Y (a  path  which  contains  no  loops) . 

(3)  A^  is  the  system  determinant  A after  we  have 
excluded  all  loops  which  touch  the  P^  path. 
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The  Mason's  Theorem  is  better  understood  by  an  example. 


Suppose  our  system  is  described  by  the  signal  flow  graph 
of  Figure  3 and  we  want  to  determine  the  overall  transfer 
function  Y/U.  The  loop  gains  are 

L,  * ab  , L2  = ce  , L3  * aicd  • 


Hence 


7 L j = ab  + ce  + aicd  . 

The  loop  touches  both  and  L2  but  and  L2  are 
non-touching . Hence 

= aicd  , 

and  there  are  no  three  non-touching  loops.  We  can  then 
write  the  determinant  A 

A - I - VLj  * !•  1*1.,  , 

or 

A * 1 - (ab  + ce  + aicd)  + aicd  . 

The  direct  paths  from  U to  Y are 


Y * T U , 


and  this  is  called  the  solution  to  our  control  model, 
i.e.,  an  expression  for  the  response  of  our  system  as  a 
function  of  any  input  to  the  system  and  a known  (derived  by 
Mason's  Rule)  overall  transfer  function. 

B.  THE  RELIABILITY  CONTROL  MODEL 

Our  concept  of  a system  is  not  limited  to  physical 
systems.  The  concept  can  be  applied  to  abstract,  dynamic 
phenomena  such  as  those  encountered  in  economics  and  opera- 
tions research.  Also,  feedback  control  systems  are  not 
limited  to  the  field  of  engineering  but  can  be  of  particu- 
lar interest  to  the  manager,  public  official,  operations 
researcher,  biologist,  and  design  engineer.  In  this  section 
we  will  structure  the  reliability  model  in  control  theory 
terms.  The  plant  of  the  control  theory  approach  will  be 
the  inventory,  where  the  (decreasing)  reliability  of  items 
is  our  variable  of  interest,  or  state  variable . The  con- 
troller will  be  substituted  by  a decision-making  function 
that  will  decide  upon  a level  of  maintenance  which  is  optimal 
in  the  sense  of  minimizing  a certain  performance  measure. 

We  will  defer  optimization  until  Chapter  VI,  and  for  the 
present  will  assume  a single  level  of  rework,  as  defined 
in  Section  D of  Chapter  II,  corresponding  to  a certain 
effectiveness  of  the  rework  a. 


H 


S«*  • 


Our  dynamic  model  is  described  by  expressions  (15)  and 
(16)  , 

R(k+1)  * Rs(k)  e-bT  , k =*  0,1,2,  ...  , 

and 

Rg(k)  =■  01(1  - R (k)  ) + R(k)  , k = 1,2,3,  .. 

and  the  signal  flow  graph  can  be  drawn  in  several  ways,  one 
of  which  is  shown  in  Figure  4.  At  the  second  node  from 
the  left  the  present  item  reliability,  whose  measured  value 
is  fed  back  to  this  point,  is  compared  with  the  reference 
value,  Rq,  that  is  made  here  equal  to  1.0  due  to  our 
definition  of  rework  effectiveness  (this  will  be  better 
clarified  later).  The  difference,  when  not  zero,  produces 
an  automatic  decision  to  rework  the  item,  and  after  the 
rework,  this  difference  becomes  multiplied  by  a since  from 
expression  (16)  we  have 

Rs(k)  - R (k)  =*  a(l  - R(k) ) = U(k)  (19) 

This  difference  will  be  denoted  by  U(k),  and  called 
the  input  to  our  plant.  Physically  the  item  is  returned 
to  the  inventory  at  this  point  and  the  reliability  of  the 
item  is  given  by  the  sum 
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U (k)  + R (k)  . 


Rs(k)  = 

This  sum  is  performed  at  the  fourth  node.  While  in  the 

inventory  the  item  reliability  will  deteriorate  by  a 
-bT 

factor  e given  by  expression  (15)  and  at  the  end  of  a 
period  of  length  T we  have  the  item  reliability  R(k+1) 
immediately  after  the  (k+l)th  rework  represented  at  the 
fifth  node  by  R^k-t-1).  The  relation  between  R(k)  and  R(k+1) 
is  a function  called  a unit  delay  of  time,  represented  by 
a box  in  the  flow  graph,  with  the  meaning  that  the  output 
of  our  system  R(k+li  is  one  period  T ahead  of  the  value 
fed  back,  R(k) , used  to  compute  it. 

The  variable  Y (k)  is  used  to  emphasize  the  fact  that 
R(k+1)  is  the  output  of  our  control  system.  Branches  with 
a gain  equal  to  1.0  are  used  when  there  are  variables  that  are 
just  renamed  or  going  to  be  operated  on  in  another  mode. 

Taking  the  z transform  on  both  sides  of  Equations  (15) 
and  (16)  by  applying  the  properties  given  in  Appendix  A, 
we  have 


R(z) 


Rs(z) 


-bT 


R ( 1 ) 


(20) 


and 


Rs(2)  = " R(2))  + R(2)  ' (21) 

and  the  signal  flow  graph  can  be  drawn  as  in  Figure  5. 
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The  response  of  the  system,  Y(z),  can  be  now  obtained 


by  applying  Mason's  theorem  as  shown  earlier.  Since  we 
can  consider  that  we  have  here  two  input  values,  namely 
R(l)  and  RQ,  this  yields  the  overall  transfer  function 
with  respect  to  the  initial  condition  R(l)  as 

Y(z)  _ 1 z 


R(l) 


n ~bT  -L  ~ -bT 
V 1 - ae  z + e 


z- (1-a) e 


-bT  ' 


and  with  respect  to  the  reference  value  RQ, 


Y ( z ) _ ae  bT(A)2 

R^  , -bT  -1  -bT 

u 1 - ae  z + e 


-bT 

ae  z 


( z — 1 ) (z-(l-a)e"bT) 


The  response  of  the  system  due  to  the  reference  value 
that  here  is  made  equal  to  1.0  is  then 


Y(z) 


RQae  bTz 


(z-1) (z- (1-a) e~bT) 


error  s 


ignal  or  input  srgnal  to  the  plant,  is  tnen  u—  - 
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This  is  the  same  as  the  z transform  of  Equation  (13) 
in  Chapter  II,  and  the  inverse  z transform  of  the  total 
response  then  gives  the  same  Equation  (13)  for  the  relia- 
bility of  an  item  immediately  before  a rework.  This  is 


Y(k)  * R(k)  = (l-a)ke"bkTR(l) — 


-bT 


(l-a)e  bT-l 


[l-(l-a)ke"bkT] , 


k = 1,2,3, 


where  the  argument  (k+1)  was  changed  to  k.  In  this  case 
the  z transform  had  to  be  applied  because  the  unit  delay 
present  in  the  system,  does  not  provide  a linear  function 
necessary  for  the  application  of  Mason's  theorem.  In  the 
z domain,  however,  the  unit  delay  becomes  a very  simple 
function  and  the  solution  may  be  found  easily. 

If  the  reference  input  RD  is  not  equal  to  1.0  but  is 
the  desired  value  of  the  item  reliability  that  we  want 
Rs (k)  to  match  after  some  reworks  then  the  definition  of 
rework  effectiveness  would  become 

R (k)  - R (k) 

3 = — 

Rh  - R(k) 

Here,  if  the  reliability  immediately  before  a rework  was 
greater  than  the  value  of  the  desired  reliability,  the 
value  of  a would  be  negative.  To  avoid  this  problem  we 
might  use  a decision  rule  that  could  be  expressed  as  a 
function  M ( R, R^)  defined  as 
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with  the  meaning  that  no  rework  has  to  be  done  when  the 
item  reliability  R(k)  is  greater  than  the  desired  value 
RD-  Our  model  would  then  become 

Rc(k)  = Rlk)  + M ( R_  - R (k)  ) (2-1) 

This  approach,  however,  would  introduce  a non-linearity 
into  our  system  that  could  not  be  eliminated  by  the  z 
transform  procedure,  and  the  solution  of  our  problem  would 
probably  have  to  be  obtained  by  computer.  Hopefully  we 
can  handle  this  problem  and  find  an  optimal  sequence  of 
reworks  that  makes  the  value  of  Rs(k)  to  match  the  desired 
value  R^  by  using  the  optimization  process  that  will  be 
developed  in  Chapter  V. 

Summarizing,  we  have  structured  the  item  reliability 
model  in  terms  of  control  theory  for  periodic  reworks  with 
effectiveness  of  rework  a as  defined  by  equation  (1) . We 
are  now  able  to  apply  the  tools  of  control  theory  to  find: 
(i)  the  limits  of  stability  of  our  system  as  a function 
of  the  rework  period  T,  (ii)  the  stable  final  value  of  the 
reliability  as  the  number  of  reworks  increase,  and  the  use 
of  a Kalman  filter.  This  will  be  shown  in  the  next  chapter. 


L 
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In  this  chapter  we  will  show  how  the  results  of  our 
control  model  can  be  applied  to  study  the  behavior  of  the 
item  reliability.  First,  we  will  study  the  stability  of 
our  system,  and  then  the  final  value  reliability  when  t 
increases.  After  introducing  randomness  to  the  system, 
we  will  show  the  use  of  a Kalman  Filter  to  estimate  the 
value  of  the  reliability  that  is  fed  back. 

A.  SYSTEM  STABILITY 

A linear  control  system  is  stable  if  the  output  even- 
tually comes  back  to  an  equilibrium  state  when  the  system 
is  subjected  to  a disturbance.  In  our  reliability  system 
we  are  interested  in  knowing  if  there  is  any  range  of  values 
of  the  rework  effectiveness  factor  a for  which  the  system 
becomes  unstable,  i.e.,  the  reliability  might  continue  to 
decrease  until  the  items  need  to  be  replaced  rather  than 
reworked. 

From  control  theory  we  know  that  the  characteristic 
equation  of  a control  system  is  equal  to  the  denominator  of 
the  overall  transfer  function  plus  1.0  and  that  for  the 
system  to  be  stable  the  roots  of  the  characteristic 
equation,  in  the  z domain,  have  to  be  inside  the  unity  circle 
[10].  For  our  reliability  system  we  have  from  Equation  (21) 
the  characteristic  equation  in  the  z domain  as 


(z-1) [z-(l-o)e  ] + 1 = 0 . 


Rearranging  our  characteristic  equation,  we  have 


9 -bT  -bT 

2T  - [l+(l-o)e  ]z  + [1+ (1-a) e = 


with  complex  roots  at 


= 1+(1~a)e  — ± j j J [l+(l-a)e"bT] 2-4 [1+ (1-a) e 


-b. 


The  absolute  value  of  these  complex  roots  is  given  by 


| z | = yri[(l-a)2e“2bT-l]  . 


Here, 


z I < 1 


or 


z <1 


i[  (1-a) 2e_2bT-l]  < 1 


when 


( l-oi)  2 v 3e2bT 


This  gives  a second  order  inequality  in  a 


a2  - 2a  + 1 - 3e2bT  < 0 


that  when  solved  shows  us  that  for  a stable  system,  the 
value  of  a must  be  within  the  range 


i bT  T . bT  ■=■ 

1-e  *3  < a < 1+e  » 3 


For  the  example  of  Chapter  II  with  b = 0.001  and 
T » 100,  we  get 


0.56  < a v 2.56 


that  agrees  well  with  the  value  of  x in  Table  I for  which 
the  item  is  "as  good  as  new"  after  each  rework. 

Outside  these  limits  or  when  a is  less  than  0.56,  \since 
a by  definition  is  less  than  unity),  the  system  is  unstable. 
Here,  the  item  will  have  its  reliability  deteriorating  with 
time  until  the  item  needs  to  be  replaced  rather  than 
reworked,  i.e.,  for  a 0.56  eventually  R -*■  0 . 


B.  THE  FINAL  VALUE  IN  STABLE  SYSTEMS 

When  the  system  is  stable  its  response  tends  to  a 
constant  value  as  the  time  increase  whenever  there  is  no 


depends  only  on  the  rework  effectiveness  oi  and  on  the  turn- 
over period  T for  a given  degradation  parameter  b,  and  is 
thus  independent  of  the  initial  value  of  the  reliability 
as  was  intuitively  observed  in  Chapter  II. 

C.  ERROR  COMPENSATION  USING  A KALMAN  FILTER 

In  this  section  we  will  show  how  a Kalman  Filter  can 
be  applied  to  our  model  in  order  to  compensate  for  errors 
in  the  measurement  of  the  item  reliability.  Again,  measure- 
ment here  does  not  imply  a physical  action.  We  suppose  the 
nature  of  the  stored  item  is  such  that  it  receives  frequent 
diagnostic  checks  which  yield  an  estimate  of  its  reliability, 
and  such  "measurements"  are  subject  to  random  error. 

In  the  model  developed  in  Chapter  III  we  have  shown  how 
the  item  reliability  is  fed  back  so  that  a decision  can  be 
made  about  doing  a rework  so  that  the  item's  reliability 
can  approach  a desired  value.  In  practice  we  have  to 
measure  the  item  reliability  or  estimate  it  by  some  way  in 
order  to  feed  back  this  observed  value.  This  measurement 
process,  however,  contributes  to  the  variance  within  the 
system.  Other  sources  of  variance  in  the  process  include 
variability  in  the  item  environment  and  in  subsystems 
reliabilities  due  to  repairing  or  substitution  of  parts. 

We  call  these  random  errors  as  noisy  or  random  input  to 
our  plant,  since  we  can  model  these  errors  as  random 
variables  that  are  input  somewhere  in  the  plant  as  will 


see  later. 


If  we  do  not  want  our  control  system  following  these 
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: 

! 

I random  inputs  excessively  it  would  be  a good  policy  to 

smooth  the  reliability  values  over  time  and  then  feed  back 
a predicted  value  upon  which  we  made  our  decisions. 

A useful,  smoothing  device  is  a Kalman  Filter,  and  a 
block  diagram  of  a general  system  with  a Kalman  filter  is 
shown  in  Figure  6.  Other  filters  could  be  used  here  but 
with  a discrete  system  we  chose  the  Kalman  filter:  it  is 
the  optimum  recursive  filter  in  the  sense  that  it  minimizes 
the  variance  of  the  estimator  error.  The  random  input  at 
the  plant  in  Figure  6 is  designated  by  the  random  variable 
aj{k)  and  represents  the  error  introduced  by  the  environment 
and  rework  process.  The  random  error  in  the  measurement 
is  designated  by  the  random  variable  v(k). 

Making  the  assumption  that  these  noises  are  additive 
expected  values,  we  can  restate  our  system  equations  (15) 
and  (16)  as 

R(k+1)  = e“bT  Ra  (k)  + w (k) 

s 

and 

Rg(k)  = (1-a)  R (k)  + oiRp, 

and  substituting  the  second  equation  into  the  first,  we 
have 


44 


R(k+1)  = e [ (l-cORfkJ+aRp]  + w(k)  . 

Rearranging  and  grouping  terms  we  have 

R(k+1)  = e_bTR(k)  + e“bTU(k)  + w(k)  (27) 

where 

U (k)  = a[RD  - R (k) ] 

as  before  and  RQ  = 1. 

If  we  introduce  the  Kalman  Filter  in  our  system  we 

A 

are  feeding  back  an  estiamted  value  R(k)  instead  of  the 
actual  value  R(k)  and  the  input  to  the  plant  becomes 

U (k)  = [Rjj  - R (k)  ] (28) 

The  measurement  process  can  be  modelled  by  the  equation 

Y(k)  = H R (k)  + v (k)  (29) 

where  H can  be  any  function  describing  the  measurement,  and 
v(k)  is  the  random  variable  in  the  measurement  process. 

We  need  the  following  additional  assumptions  to  make 
the  application  of  a Kalman  Filter  valid: 

(a)  The  measurement  error  v(k)  and  the  random  process 

input  w(k)  has  zero  mean  and  are  uncorrelated  between 
states,  with  variances  S and  Q respectively,  or 
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E [v  (k)  v ( j ) ] - S «k.  , k,j  = 0,1,2 

E[w(k)w( j) ] = Q 5kj  , k, j = 0,1,2,  ...  , 

where  5^^  is  the  Kronecker  delta  function. 

(b)  The  initial  state  is  a random  variable  which  has 
known  mean  E ( R ( 0 ) ] ■ RQ  and  variance  M. 

(c)  The  estimator  is  characterized  by  the  linear 
relationship 

R(k|k)  = R(k | k-1)  + G(k)[Y(k)  - HR(k|k-l)J  , k = 0,1,2,..., 

where : 

A 

R(k|k)  is  the  optimal  estimate  of  R(k)  given 
observations  at  times  up  to  and  including  k, 

R(k|k-1)  is  the  optimal  prediction  of  R(k)  given 
observations  at  times  up  to  and  including  k-1,  and 
G(k)  is  the  gain  of  the  Kalman  Filter  at  each  step. 

(d)  The  random  input  and  initial  state  are  uncorrelated. 

(e)  The  random  errors  in  the  plant  process  or  random 
input  w(k)  and  the  random  error  in  the  measurement 
process  v(k)  are  uncorrelated  or 

E [w (k) v ( j ) ] = 0 j ,k  = 0,1,2 


'* 


The  functioning  of  the  Kalman  filter  is  by  predicting 
the  value  of  the  item  reliability  R(k|k-1)  using  the  esti- 
mated value  at  the  end  of  the  (k-l)th  period,  multiplying 
this  predicted  value  by  the  function  H,  so  that  this  new 
value  can  be  directly  compared  with  the  measured  value. 

The  filter  gets  the  correction  term  [Y (k) -HR (k j k-1) ] 
that  can  be  conveniently  weighted  by  the  gain  G(k)  to 
correct  the  predicted  value,  and  obtains  a new  estimated 
value  for  the  kth  period. 

Notice  that  if  we  did  not  use  a predicted  value, 
what  is  equivalent  to  say  that  R(k.k-l)  = R(k-ljk-l)  * R(k-l), 
we  would  have  exponential  smoothing  and  the  gain  G(k) 
would  then  be  the  smoothing  constant.  With  the  predicted 
value  any  trend  is  recursively  incorporated  in  the  esti- 
mated value. 

.a 

The  best  prediction  R(kjk-l)  that  can  be  made  is 
clearly  by  using  our  model  (Equation  (27)), 

R (k  | k-1)  = e~bT  R(k-ljk-l)  + e"bT  U(k-1)  , (30) 

and  from  assumption  (c)  above,  the  equation  for  the  esti- 

A 

mated  value  R(k|k)  is 

A A A A 

R (k)  =*  R (k  | k)  = R (k  j k-1)  + G (k)  [Y  (k)  -HR  (k  | k-1)  ] . 

(31) 

With  these  two  equations  and  the  assumptions  above  it 
is  shown  [9]  that  the  sequence  of  gains  that  minimises  the 
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variance  of  the  estimator  error  P(k|k)  is  given  by  the 
recursive  equations 


G (k)  = P(k|k-l)H[H2P(k|k-l)+S]~1  , 


P (k  | k) 


[1  - HG (k) ] P(k;k-1)  , 


P (k | k-1)  = (e-bT) 2P(k-l|k-l)  + Q. 


These  are  initialized  by  the  value 


P (0  ! -1)  =■  M . 


From  these  equations  we  can  see  that  the  Kalman  Filter 
gain  G(k)  does  not  depend  on  the  measurement  values  Y(k), 
and  can  thus  be  computed  in  advance  and  stored  for  later  use 
when  processing  the  measurements  as  they  become  available. 

We  can  see  also  that  the  gain  at  time  k,  G(k),  is  inversely 
realted  to  the  variance  of  measurement  error  S — the  more 
uncertainty  in  the  measurements,  as  reflected  by  a larger 
S,  the  smaller  G(k)  will  be,  and  the  less  the  correction 
term  [Y (k) -HR (k | k-1) ] in  Equation  (31)  will  be  weighted  in 
determining  the  next  estimate.  The  random  input  error  Q 


also  affects  the  gain  G(k),  and  as  the  uncertainty  in  the 
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prediction  of  P(k|k-1)  increases  and  the  more  uncertainty 
we  have  in  our  model,  the  larger  will  be  G(k).  For  large 

A 

values  of  M or  no  confidence  in  the  initial  guess  R ( 0 | — 1 ) 
the  filter  makes  R ( 0 | 0 ) equals  to  the  first  measurement 
Y(0)  since  G ( 0 ) is  equal  to  1.0.  When  the  initial  guess  is 
better  the  filter  makes  a weighted  combination  of  the  guess 
R(0|-1)  and  the  first  measurement  Y(0),  as  one  can  conclude 
from  Equation  (31) . 

A flow  graph  in  the  time  domain  of  our  system  is  shown 
in  Figure  7.  The  lower  part  of  the  flow  graph  is  the 
Kalman  Filter,  which  receives  as  input  the  measured  value 
Y(k)  and  the  input  to  the  plant  U(k),  and  has  as  output  the 
estimated  value  R(k) . This  is  multiplied  by  the  measurement 


function  H and  the  result  is  compared  with  the  observed 
value  Y(k).  The  difference  is  then  multiplied  by  the  gain 


G(k)  and  summed  to  the  predicted  value  to  produce  the 
estimated  value,  as  given  by  Equation  (31). 

When  we  have  more  than  one  state  variable,  an  advantage 
of  the  Kalman  filter  not  shown  here  is  that  we  do  not  need 
to  measure  all  state  variables  but  only  a smaller  number 
to  get  all  the  estimated  values  we  need  to  feed  back  to  the 
plant. 

As  an  example,  suppose  we  have  values  from  Table  I in 

A 

that  oi  = 0.7,  b = 0.001,  T = 100  and  Rq  = 0.8;  suppose  also 

that  the  variance  in  the  estimated  value  of  Rq  is  M = 0.1, 

and  that  the  variances  in  the  random  input  and  in  the  measure- 
ment are  known  to  be  Q = 0.1  and  S = 0.1.  Let  our  measure- 

ment equation  be  given  by 


Y (k) 


R (k)  + v (k) 


which  in  terms  of  Equation  (29),  implies  H * 1.  With  these 
values  we  can  compute  the  Kalman  filter  gain  for  four 
periods  using  Equations  (32)  to  (35): 


G (0 ) = 0.5, 

G ( 1 ) = 0.58, 

G ( 2 ) = 0.60, 


G ( 3 ) = 0.60,  and 

G (4)  = 0.60. 


Suppose  the  measured  values  are 


Y ( 1 ) = 0.75  , 

Y ( 2 ) = 0.82  , 

Y ( 3 ) =■  0.86  , and 

Y ( 4 ) = 0.85. 


and  we  guess  a value  for  the  initial  reliability 

A 

Rd',0)  = 0.724.  We  obtain,  by  using  Equations  (30)  and  (31), 
the  values 
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We  can  then  write  our  state  equation  for  the  system  with 
random  input  as 

A 

R (k+1)  = t R(k)  + $ U(k)  + w (k)  , (36) 

where  the  matrix  4>  is 


"blT 


0 

0 

0 


"b2T 


0 0 

0 0 

-b  T 

e J 0 


-b4T 


The  measurement  equation  is 


Y(k)  - H R ( k)  + v (k)  , 


(37) 


and  the  vector  of  estimated  values  is  given  by 

A A A 

R(k)  =*  R(k|k)  = R (k  | k-1)  +G(k)[Y(k)  -HR(kjk-l)] 

(38) 

and  the  vector  of  predicted  values  by 


* — HT  ' — hT 

R(k  | k-1)  =*  e ° R (k-1 1 k-1 ) +6  7"-  U(k-l), 

(39) 


where  G(k)  is  the  vector  of  the  Kalman  filter  gains. 
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If  we  are  interested  in  the  overall  system  reliability 
and  if  as  in  the  missile  case  the  subsystems  are  inde- 
pendent and  in  series,  we  have  the  output  equation 


" Ri(k) 


which  can  be  added  to  the  control  signal  flow  graph  as 
shown  in  Figure  8.  For  subsystems  arranged  in  parallel 
or  series-parallel,  the  system  can  be  handled  in  a similar 
manner,  and  needed  changes  in  the  output  equation  will  not 
influence  the  system  itself. 

In  this  chapter  we  applied  tools  from  control  theory 
to  our  reliability  model  and  showed  how  to  find  the  limits 
of  the  rework  effectiveness  a for  which  the  system  is 
stable  and  the  final  value  of  the  item  reliability  when  k 
becomes  large.  We  also  showed  how  a Kalman  filter  may  be 
applied  to  smooth  the  estimated  values  of  item  reliability 
and  feed  back  this  estimated  values  upon  which  the  decision 
about  a is  made. 

In  the  next  chapter  we  will  show  how  the  decision 
about  a can  be  optimized  with  respect  to  a given  performance 
measure. 


L m 


Kalman 

Filter 


Signal  flow  graph  for  multidimensional  rework 
control  system 


FIGURE  8. 


V.  OPTIMIZATION 


In  the  previous  chapter  we  have  studied  our  control 
model  for  the  case  we  have  linear  equations  and  a single 
level  of  rework  effectiveness  a.  In  this  chapter  we  will 
extend  this  study  for  non-linear  equations  and  several 
levels  of  rework  effectiveness,  and  show  how  to  find  the 
sequence  of  rework  that  optimizes  a given  performance 
criteria.  First  we  will  discuss  various  performance 
criteria  that  could  be  used  for  our  control  model,  and  then 
we  will  show  how  to  find  the  optimal  sequence  of  rework 
levels  by  dynamic  programming. 

A.  THE  PERFORMANCE  MEASURE 

The  optimal  control  problem  in  our  thesis  is  to  find 
a control  u(k)  as  defined  by  the  expression 

u(k)  = a (k)  (Rd  - R(k)  ) , (40) 

which  causes  the  system  to  follow  a trajectory  that  opti- 
mizes a performance  measure  J.  The  rework  effectiveness, 
a(k),  is  now  allowed  to  change  from  step  to  step  and  in 
fact  the  problem  now  becomes  one  of  finding  the  sequence 
of  rework  effectiveness  ct  ( k ) that  yields  the  optimal 
sequence  of  control  u(k) . Notice  that  since  a(k)  is  no 
longer  constant,  Expression  (40)  is  non-linear. 
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First  let  us  consider  a trajectory  (that  is,  the 
sequence  of  values  the  item  reliability  follows  over  time) 
that  attains  the  desired  reliability  with  a smallest  num- 
ber of  reworks.  This  type  of  problem  is  called  a "Minimum- 
Time"  problem  and  the  performance  measure  to  be  minimized 
may  be  generally  stated  as 


J = 


/ dt 


for  the  case  of  our  discrete  system,  this  becomes 


J 


N-l 


l T , 

k=0 


where  (N-l)  is  the  first  period  the  desired  reliability, 

RD,  is  attained. 

If  instead  we  want  to  minimize  the  deviation  of  the 
first  state  of  our  system  from  its  desired  value  we  have 
the  type  of  problem  called  a "Terminal  Control"  problem. 

Here,  possible  performance  measures  are 

N 

J = l Rd  - Rsi(k)  , 

i 

where  the  summation  is  done  in  all  dimensions  or  reliabili- 
ties of  the  sub-systems . If  positive  and  negative  deviations 
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are  equally  undesirable  these  deviations  should  be 
squared. 

To  transfer  a system  from  an  arbitrary  initial  state 
Rq  to  some  specified  desired  value  with  minimum  expenditure 
of  control  effort  or  with  minimum  cost,  we  need  to  minimize, 

N-l  N-l 

J - l C (k)  T ■ l cu  (k)  T , 
k*0  k*0 

where  we  assume  that  the  cost  of  a rework  C(k)  is  propor- 
tional to  the  control  u(k)  or  equivalently  that  the  cost 
is  proportional  to  the  reliability  improvement,  R (k)  - R(k) , 
after  each  rework. 

Since  these  criteria  are  completely  distinct  in  their 
concepts,  we  shall  follow  the  usual  approach  of  using  a 
combination  of  them,  that  for  the  one  dimensional  problems 
takes  the  form, 


N-l 

J * HN[Rq  - Rg(k)]  + l [Q*  + cu (k) ] T 

k=0 

or 

N-l 

J = HN(Rd  - Rg(k)]  + l [Q  + Gu (k) ] , (41) 

k-0 
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where  HN,  Q and  G are  relative  weights  so  that  by  adjusting 
their  values  we  can  weight  the  relative  importance  of  each 
criteria  with  respect  to  the  other.  These  weighting  fac- 
tors can  be  functions  of  time  if  the  relative  importance 
varies  with  time.  Notice  that  now  the  performance  measure 
is  a combination  of  criteria  and  has  no  physical  meaning. 

It  should  be  noticed  also  that  the  rework  effectiveness 
a(k)  now  has  the  definition  given  at  the  end  of  Chapter  III: 


Rs(k)  - R(k) 
RD  ' R(k) 


and  that  even  when  R^  is  not  equal  to  1.0  we  do  not  need 
the  decision  rule 


RD  - R(k)  < 


a (k)  if  Rd  - R (k)  > 0 


because  the  constraints  in  ct(k)  do  not  permit  a to  become 
negative. 


B.  OPTIMIZATION  USING  DYNAMIC  PROGRAMMING 

We  now  wish  to  show  how  the  performance  of  our  rework 
control  system  may  be  optimized  in  terms  of  the  combined 
performance  measure  (41) . An  optimal  solution  would  be 
expressed  as  a sequence  of  reworks  that  minimizes  this 
criterion.  We  shall  approach  the  problem  with  the  method 
of  dynamic  programming,  as  developed  by  Bellman. 
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The  basic  notion  here  is  given  by  Bellman's  principle 


of  optimality: 

"An  optimal  policy  has  the  property  that  whatever  the 
initial  state  and  initial  decision  are,  the  remaining 
decisions  must  constitute  an  optimal  policy  with  regard 
to  the  state  resulting  from  the  first  decision” [5] . Thus 
if  J£+^  N(R(k+l))  is  the  minimum  cost  to  reach  the  final 
state  at  k = N,  starting  from  the  state  R(k+1)  at  time 
t = (k+l)T,  and  is  the  cost  to  move  from  kth  to  the 

(k+l)th  state,  then  C£N ( R (k) , u (k) ) , the  minimum  cost  to 
go  from  the  kth  to  the  (k+l)th  state  when  we  use  a particu- 
lar control  u(k)  is  given  by 

C*N(R(k)  ,u(k))  = Jk,k+l(R(k)  ,u(kn  + Jk+l,N(R(k+1M  * 

(42) 

The  optimal  decision  at  the  instant  k,  u*(k),  is  the 

decision  that  minimizes  C.*  ( R (k)  , u (k)  ) over  the  set  of 

kN 

possible  controls  u(k) , 

J*  <R(k)  ) = min  [C*  (R  (k)  , u (k)  ) ) . (43) 

KN  u (k) 

Expressions  (42)  and  (43)  form  the  functional  equations 
of  our  dynamic  programming  approach.  The  optimal  sequence 
of  decisions  are  built  up  from  the  final  state  N backwards 
toward  the  earlier  states.  This  is  necessary  in  order 
that  J*  be  known  prior  to  the  calculation  of  C*.  The  values 
of  R(k)  are  given  by  our  model,  and  the  constraints  of  the 
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problem  are 


0.0  < R (k)  < 1.0 

and 

0.0  < ot(k)  < 1.0 

The  first  step  in  the  computational  procedure,  then, 
is  to  find  the  optimal  policy  for  the  last  stage  of  opera- 
tion. This  is  essentially  a matter  of  trying  all  of  the 
allowable  control  values  at  each  of  the  allowable  state 
values.  To  limit  the  required  number  of  calculations,  and 
make  the  computational  procedure  feasible,  the  allowable 
state  and  control  values  are  discretized.  The  degree  of 
approximation  depends  on  the  separation  of  these  discrete 
values  and  on  the  method  of  interpolation  used  and  can, 
of  course,  be  adjusted. 

For  each  discrete  value  of  R(N-l)  we  try  all  discrete 

values  of  u(N-l)  and  calculate  the  resulting  state  R(N) . 

The  optimal  control  for  this  rework  is  the  one  which  yields 

the  minimum  cost.  The  procedure  is  repeated  for  all  the 

other  discrete  values  of  R(N-l) . This  gives  a table  of 

optimal  policy  for  each  value  of  R(N-l)  at  the  last  stage. 

Since  the  cost  J , „ is  dependent  on  the  value  of  the 
N-l , N 

state  R (N-l)  and  on  the  value  of  the  input  applied,  u(N-l) , 
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the  minimum  cost  J*  and  the  optimal  control  u*(N-l)  are 
dependent  on  the  value  of  the  state  R(N-l) . For  the  last 
rework  we  use  only  the  first  term  (terminal  control)  of 
our  performance  measure  (41) , but  for  the  other,  successive 
stages  we  must  compute  each  term  in  that  expression.  When 
a state  does  not  coincide  with  one  of  the  discrete  values 
we  have  to  use  interpolation  to  find  the  corresponding  value 
of  the  performance  measure.  Since  a direct  search  is  used 
to  solve  the  functional  equations,  the  solution  obtained 
is  regarded  as  the  global  minimum. 

A flow  chart  describing  the  computational  procedure  is 
shown  in  Figure  9.  A Fortran  program  for  this  flow  chart 
is  described  in  Appendix  B. 

As  an  example  of  the  use  of  this  dynamic  programming 
procedure,  we  sought  the  optimal  sequence  of  reworks  for 
the  case  where  b = 0.001,  T = 100,  and  constraints, 

0.8  < R(k)  < 1.0 


and 


0.7  <_  a(k)  £ 1.0  . 

We  chose  to  work  with  twenty  discrete  values  for  R(k) , 
thirty  discrete  values  for  ot  ( k ) , and  four  reworks.  We 
input  in  the  program  the  equations  of  our  model: 


► 


THIS  ?AOS 


SCAT  injait  data:  nixfesr  of 
staccs  ■ \’i  nvrtwr  of  state 
nluw  • NX:  rivrtxr  of 
'ortrol  values  • NU:  .'t nor 
required  ui  format  icn 


, 1 , 

S • 3 

Cal  julats  and  store  J*f 
-unirtn  oost  of  ‘.oat  <taoe'  j 
for  all  iiacrste  •al-"s  of 
a-v  I 


K ■ .<  * l 

Set  a.*<: . equal  to  t>.e  Leswr 
vu.ioretured  “Moe  oy  ttakinq 


- 


i 

Sat  C5SMDI  to  % large 
;o«utiv»  r.-^r^ar*  SZ?L’{\)  + 
■>-mI  to  t>.e  lessor 
liioretirsd  value  _y 


C'.anc^  Rt>)a  to  ti*.* 
next  discrete  value 


FIGURE  9.  Flow  chart  of  the  computational  procedure  ror 
the  dynamic  programming  solution  for  optimal 
control  of  the  rework  control  system 


' 


65 


R(k)  + ot  (k)  ( 1-R (k)  ) 


R(k+1) 


Rs(k)  e 


and  considered  as  input  variable  the  rework  effectiveness 
a(k)  since  in  this  program  the  equations  need  not  be  linear 
and  this  is  the  variable  of  immediate  interest  for  the  user. 
For  the  performance  measure  J given  by  Expression  (41) 
we  considered  four  distinct  types  of  problems  obtained  by 
changing  the  weights.  These  are: 

(1)  Minimum  Cost,  so  that  the  weights  of  the  combined 
criterion  J (41)  are 

G = 1.0,  Q = 0.0  and  HN  = 0 . 0 , 

(2)  Terminal  State,  or  minimizing  deviations  from  the 
final  value.  Here  the  weights  in  J are 

G = 0.0,  Q = 0 . 0 and  HN  = 1.0  , 

(3)  Terminal  State  and  Minimum  Cost,  where  we  assume 

a desired  reliability  RD  * 0.99,  and  a relatively  important 
terminal  state  represented  by  the  weights 


and 


(4)  The  linear  combination  of  the  three  criteria 
represented  by  the  weights 

G = 0.05  , Q = 0.05  and  HN  = 500.0. 

The  dynamic  programming  solutions  for  the  four  cases 
are  presented  for  each  rework  period  in  the  Computer  Output 
Section  of  this  thesis.  From  these  solutions  we  can  now 
find,  for  each  of  the  four  cases,  the  optimal  sequence  of 
reworks  for  a given  initial  reliability  Ro  (entering  with 
this  value  at  the  first  rework  table  and,  interpolating 
among  the  values  listed,  we  can  follow  the  process  until 
the  final  state  is  reached) . 

The  results  are  in  Tables  II  to  V for  two  values  of 
initial  reliability  of  an  item.  As  we  can  see  from  these 
tables,  the  sequence  of  reworks  that  minimizes  our  perfor- 
mance measure  depends  on  the  value  of  the  initial  reliability 
RQ,  for  given  values  of  the  desired  reliability  Rp  and  of 
weightings  in  the  performance  measure. 

Summarizing,  we  have  applied  a dynamic  programming 
procedure  to  our  control  model  of  the  reliability  of  an 
item  and  were  able,  for  the  four  selected  cases,  to  find 
an  optimal  sequence  of  reworks  that  minimizes  a selected 
performance  measure.  For  other  selections  of  performance 
measure  J,  relative  weightings  HN,  Q and  G,  constraints, 
initial  reliability  R and  model  parameters  b and  T,  we 


TABLE  II 


RELIABILITY  FOLLOWING  REWORK  FOR  INITIAL  RELIABILITY 
Rq,  AND  OPTIMAL  SEQUENCE  OF  REWORK  LEVELS  ct(k) 


Case  (1)  - Minimum  Cost 
PERFORMANCE  MEASURE:  J 


N-l 


[KD_Rs(lc)  lH  + l Q+GU(k> 
k=0 


with 

H - 0.0  , Q - 

0.0  , 

G * 1.0  and 

i 

Ro  = 0.8 

k 

Rs(k) 

a(k) 

Rg (k+1) 

o 

0.800 

0.60 

0.890 

1 

0.890 

0.60 

0.924 

0.924 

0.6Q 

0.933 

3 

0.933 

0.60 

0.936 

4 

0.926 

R =*  0.9 
o 

k 

Rs  (k) 

o(k) 

Rs(k+1) 

0 

0.900 

0.60 

0.926 

1 

0.926 

0.60 

0.933 

2 

0.933 

0.60 

0.936 

3 

0.936 

0.60 

0.937 

4 

0.937 

U (k) 


a (k) 


'I; 

i 


f 

I 


1 

■ 

TABLE  III 

RELIABILITY  FOLLOWING  REWORK  FOR  INITIAL 
RELIABILITY  R , AND  OPTIMAL  SEQUENCE  OF 
REWORK  LEVELS  a(k) 

Case  (2)  - Terminal  State 

N-l 

PERFORMANCE  MEASURE:  J = [R^-Rs(k)]H  + £ Q+GU(k) 

k=0 

with  Rd=0.99,  H = 1.0  , Q = 0.0  , G = 0 . 0 
and  U(k)  = ot(k) 


R = 0.8 

o 


k 

Rs(k) 

ct  (k) 

Rs(k+1) 

0 

0.800 

0.90 

0.972 

1 

0.972 

0.90 

0.988 

2 

0.988 

0.90 

0.990 

3 

0.990 

0.90 

0.990 

4 

0.990 

R _ = 0.9 
o 


k 

Rs(k) 

ot  (k) 

Rs(k+1) 

0 

0.900 

0.90 

0.982 

1 

0.982 

0.90 

0.989 

2 

0.989 

0.90 

0.990 

3 

0.990 

0.90 

0.990 

4 

0.990 
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TABLE  IV 


RELIABILITY  FOLLOWING  REWORK  FOR  INITIAL  RELIABILITY 
Rq  AND  OPTIMAL  SEQUENCE  OF  REWORK  LEVELS  a(k) 

Case  (3)  - Terminal  State  with  Minimum  Cost 

N-l 

PERFORMANCE  MEASURE:  J = [R  -R  (k)]H  + £ Q+GU(k) 

k=0 

with  RD  0.99  , H = 500.0  , Q = 0.0  , G=0.9 

and  U(k)  = c*(k) 


R_  = 0.8 

o 


k 

Rs(k) 

a(k) 

Rs(k+1) 

0 

0.8 

0.60 

0.890 

1 

0.890 

0.60 

0.924 

2 

0.924 

0.60 

0.933 

3 

0.933 

0.867 

0.979 

4 

0.979 

R 

o 

0.9 

k 

Rs(k> 

a(k) 

Rs (k+1) 

0 

0.900 

0.60 

0.926 

1 

0.926 

0.60 

0.933 

2 

0.933 

0.60 

0.936 

3 

0.936 

0.864 

0.978 

4 

0.978 
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TABLE  V 


RELIABILITY  FOLLOWING  REWORK  FOR  INITIAL  RELIABILITY 
Rq,  AND  OPTIMAL  SEQUENCE  OF  REWORK  LEVELS  a(k) 

Case  (4)  - Terminal  State  in  Minimum  Time  with 
Minimal  Cost 

N-l 

PERFORMANCE  MEASURE:  J =■  [R^-Rg  (k)  ] H + T Q+GU(k)  , 

k=0 

with  Rq  = 0.99  , H = 500.0  , Q = 0.05  , G * 0.05 
and  U(k)  = a(k) 


R_  = 0.8 

o 


k 

Rs(k) 

oc(k) 

Rg(k+1> 

0 

0.800 

0.60 

0.890 

1 

0.890 

0.60 

0.924 

2 

0.924 

0.868 

0.977 

3 

0.977 

0.90 

0.989 

4 

0.989 

R = 0-9 

o 


k 

Rs(k) 

a(k) 

Rg  (k+1) 

0 

0.900 

0.60 

0.926 

1 

0.926 

0.60 

0.933 

2 

0.933 

0.835 

0.973 

3 

0.973 

0.90 

0.988 

VI.  CONCLUSIONS  AND  RECOMMENDATIONS  FOR  FURTHER  STUDY 


A simple,  closed- loop  inventory  storage  system  from 
which  the  stored  items  are  removed,  sent  through  a rework 
mechanism  to  improve  their  reliability,  and  returned  to 
storage  has  been  investigated  in  this  thesis.  Such  a sys- 
tem might  be  a stock  of  large  ordnance  which  is  acquired, 
stored  and  reworked  at  regular  intervals. 

A general  rework  model  was  developed  by  using  the  tools 
of  control  theory  and  a solution  in  closed  form  was  found 
that  permits  further  analysis  of  the  system  in  a much  easier 
way  than  if  we  had  a solution  in  the  form  of  series.  This 
model  also  permitted  us  to  find  in  a direct  way  the  values 
of  effectiveness  of  the  rework  that  makes  the  system  unstable 
and  the  final  value  of  the  item  reliability  over  several 
reworks  when  the  system  is  stable. 

A Kalman  filter  was  used  in  the  control  model  to  obtain 
an  estimation  of  the  item  reliability  when  we  have  random 
error  in  our  measure  of  the  item  reliability  or  when  the 
rework  process  introduces  randomness  in  the  item  relia- 
bility. This  model  was  extended  to  more  than  one  dimension 
for  the  case  where  we  have  systems  composed  of  several 
subsystems  in  series,  parallel,  or  both.  Finally  a study 
was  made  for  the  case  where  we  can  have  several  levels  of 
rework  and  want  to  find  the  optimal  sequence  of  such  reworks 
that  minimizes  a performance  criteria  that  leads  to  the 
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case  of  minimum  time,  minimum  cost,  terminal  state  or  a 
linear  combination  of  these  criteria. 

This  thesis  shows  that  control  theory  may  be  applied 
for  administrative  problems  where  a mathematical  model  des- 
cribing the  system  can  be  derived.  Control  theory  gives 
a broader  understanding  of  the  problem  and  due  to  its  flexi- 
bility would  permit  us  to  include  in  the  model  many  other 
variables  not  studied  in  this  thesis. 

Among  the  several  interesting  areas  which  might  be 
pursued  in  further  study,  one  is  to  determine  methods  for 
measuring  or  estimating  the  item  reliability  by  frequent 
diagnostic  checks  so  that  this  measurement  process  can  be 
incorporated  in  the  model.  Another  area  is  to  broaden  the 
field  of  the  rework  model  so  that  other  state  and  input 
variables  could  be  incorporated.  These  include  the  proba- 
bility that  an  item  chosen  at  random  might  have  reliability 
exceeding  some  predetermined  reliability  requirement,  and 
other  input  variables  (such  as  items  expended  for  training 
purposes,  use,  or  obsolescence,  as  well  as  new  items  acquired 
periodicaly) . The  rate  of  rework,  the  rate  of  expenditure, 
or  the  rate  of  acquisition  could  then  be  sought  as  control 
variables  besides  the  rework  effectiveness.  Non-linear 
functions  caused  by  the  decision  rule  of  doing  a rework 
only  when  the  item  reliability  is  smaller  than  the  desired 
value,  can  also  be  solved  in  terms  of  non-linear  control 
theory. 


A reliability  control  model  has  been  developed  in  this 
thesis  for  a system  of  stored  items  requiring  rework. 

It  is  hoped  that  the  results  presented  here  will  not  only 
be  useful  to  inventory  managers  and  high-level  planners 
but  will  also  generate  further  interest  in  the  application 
of  control  theory  to  administrative  problems. 
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APPENDIX  A 


1 

A 

Z TRANSFORM 

A.  1 DEFINITIONS  AND  PROPERTIES 

The  solution  of  difference  equations  by  the  z-transform 
method  is  very  useful,  because  we  can  transform  difference 
equations  into  algebraic  equations  in  z.  Once  solved 
this  algebraic  equation  we  can  then  find  the  inverse  z 
transform  of  this  solution  to  obtain  the  solution  in  the 
time  domain. 

Thus,  given  a discrete  function  of  t,  f(kT),  the 
z-transform  of  this  function,  symbolized  by  F(z),  is  defined 
by 


Z ( f (kT) ] = F (z)  ^ l f(kT)z“k  (44) 

k=0 


From  this  definition  we  can  obtain  several  useful 
properties.  For  example,  let's  find  the  z-transform  of 
f ( (k+l)T) : 


3 [f (k+1) T) ] 


l f ( (k+1) T) 2 
k=0 


00 

z ( l f (kT) z~k  - 
k-0 


= V f(kT)z~k+1 
k=l 

f (0)  ] =■  z F ( z ) — zf  (0)  . 

(45) 


I 
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The  z-transform  of  the  most  common  functions  are  given 
in  several  references  listed  in  the  Bibliography  [1] , [4] 
and  [10]  . 

The  inverse  transform  of  F(z)  is  f(kT),  and  is  denoted 
by 


Z_1  [F  (z)  ] = f(kT)  . (50) 

From  the  tables  of  z-transform  we  can  find  the  inverse 
of  the  simplest  function.  More  complicated  z-transforms 
may  have  to  be  expanded  into  partial  fractions  so  that  the 
tables  can  be  used.  Normally,  we  expand  F(z)/z  instead  of 
F(z)  into  partial  fractions  because  this  leads  to  functions 
with  z in  the  numerator  after  we  multiply  back  by  z,  and  the 
functions  of  z appearing  in  tables  of  z transforms  usually 
have  the  factor  z in  their  numerators. 

When  the  partial  fraction  expansion  does  not  give 
tabulated  functions,  we  may  have  to  find  the  appropriate 
z-transform  from  the  definition.  This  will  be  the  case 
in  our  problem. 

Similar  properties  of  z-transforms  exist  for  inverse 
z transforms  and  will  be  useful: 

z"1(F(z)/z]  = z“1[z_1F(z)]  = f [ (k-1) T ] , (51) 

Z_1[aF(z)]  = aZ-1[F(z)]  = af (kT)  , (52) 

78 

I I ■ ■ — 


z'1^ 


a l(kT)  = 


for  t > 0 , 


2_1[F1(z)  + F2(z) ] « Z*1[F1(z)  + Z_1 [F2  (z) ] . 


The  characteristic  equation  of  a system  is  equal  to 
the  denominator  of  the  overall  transfer  function  and  the 
stability  of  the  system  can  be  determined  from  the  location 
of  the  roots  of  the  characteristic  equation  [10]  . A con- 
dition for  stability  is  that  all  roots  must  lie  inside  the 
unit  circle  or 


zil  " 1 


Another  important  property  of  the  z transform  is  the 
Final  Value  Theorem  [10]: 

"If  x(t)  has  the  z transform  X(z)  and  X(z)  has  no 
poles  (roots)  outside  the  unit  circle  (|zj  < 1,  that  is  the 
condition  for  stability) , then  the  final  value  of  x(t) 
or  x(k)  is  given  by 


lim  x(t)  = lim  x(k) 

£-*O0  fc-»»00 


To  prove  this  note  that 


lim[ (z-l)X(z) ] (56) 
z-*l 


Z [x(k>  ] * X(z)  = £ x(k)  z k 

k=0 
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► 


Z [ x(k+l)  ] =»  ZX  (z)  - Zx(0 ) * l x(k+l)  z“k 

k=0 

Hence 

zX(z)  - zx(0)  - X ( z ) = (z-l)X(z)  - zx(0 ) 

00  00 

= l x(k+l)  z_k  - l x(k)  z"k 
k=0  k=0 

from  which  we  obtain 

00 

(z-l)X(z)  = zx(0)  + l [ x(k+l)  - x ( k ) ] z“k 

k=0 

' i 

Because  of  the  assumed  stability  condition,  we  obtain, 
as  z ♦ 1, 

i 

lim  [ (z— l)X(z)  ] = x(0)  + x(oo)  _ x( 0 ) = x(«) 
z-1 

which  is  Equation  (56) . 

h 

I 

A. 2.  Z TRANSFORMS  OF  EQUATIONS  (8)  AND  (9) 

We  found  that  the  reliability  immediately  before  the 
(k+l)th  rework  is  given  by  equation  (57). 


R(k+1)  = (l-ct)e‘bTR(k)  + ae"bT  (57) 


are  constants,  we  can  apply 


-bT 

Since  (l-ct)e  and  oiR^e 
the  properties  (45) , (46) , (47) , (48)  and  (49)  to  find  the 
z-transform  of  both  sides: 

-bT  -bT 

Z(R((k+l)T)]  = Z [ ( 1-ct)  e ° R(kT)]  + Z[ae  ] 


— hT  — bT 

- Z[R( (k+l)T) ] = (l-a)e  DiZ(R(kT) ] +ae  Z[l(kT)] 


zR(z)  - ZR ( 1 ) = 


(l-a)e  bTR(z)+  ae  bT 


z-1 


which  is  Equation  (12)  of  Chapter  I when  we  use  R(l) 
the  initial  condition. 

Similarly  for  Equation  (8) : 

-bT 

Rs  ( (k+1)  T)  = ( 1-a)  Rs  (kT)  e + ct 

-bT  Z 

zRg(z)  - zR ( 0)  = (l-u)e  Rs(z)  + a 


which  is  Equation  (10)  of  Chapter  I. 

A. 3.  EXPANSION  INTO  PARTIAL  FRACTIONS 

Equations  (58)  and  (60)  can  be  solved  for 
and  R(z) , giving: 


Rs(z) 


z-  (1-ct)  e 


-bT 


R(0)  + 


az 


(z-  (1-ct)  e T]  [z-1] 
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(58) 


as 


(59) 

(60) 


Rs(z) 


(61) 


~ -bT 

2 p / n \ x Z 

-bT^  1 + -bT 

z-(l-ot)e  Di  [z-  (1-a)  e Di  ] [z-1] 


In  order  to  have  simpler  expressions  we  can  proceed  now  to 
expand  into  partial  fractions.  We  will  exemplify  it  for  the 
last  equation  only,  since  they  differ  only  by  a constant 
factor  in  the  last  term. 

The  first  term  has  already  a simple  form  so  that  we 
need  only  to  expand  the  last  term.  For  reasons  stated  in 
Section  A. 2,  we  will  expand  this  term  divided  by  z: 


. -bT 

1 ote  z 

z [z-  (l-cOe‘bT]  [z-1] 


[z- (1-a) e U1]  [z-1] 


2-1  z-(l-a)e~bT 


To  determine  the  coefficient  A we  can  multiply  both 
sides  by  (z-1)  and  evaluate  the  expression  at  z = 1: 


-taT 

z-(l-a)e  z=l 


A + [ 


B ( Z-1) 

z-(l-a)e  bT  z*l 


This  gives 


1-  (l-ct)e 


To  evaluate  B we  multiply  both  sides  by  [z- (1-a) e-bT] 
and  evaluate  at  z = (l-ci)e  , so  that  the  term  with  A 
becomes  zero: 


-bT 

016 
Z“  1 


z» ( 1-a) e 


-bT 


0 + B , 


this  gives 


B 


ae 


-bT 


(l-a)e“bT-l 


Substituting  back  into  (63)  , we  have 


ae 


-bT 


ae 


-bT 


(z-l) [2-(l-a)e'bT]  [1- (1-a) e~bT] [z-1] 


ae 

~-Bt 


-bT 


( (l-a)e  -1]  [z-  (1-a) e 


-bT, 


and  R(z)  can  now  be  put  in  the  form: 


R(z) 


z- (1-a) e 


^bTRa)  + 


-bT 

ae 

-bT 

(l-(l-a)e  D1) 


+ 


[ z-  ( 1-a)  e~bT] 


ae 


-bT 


[(1-a) 


(64) 


The  expansion  for  Rg(z)  follows  immediately  from  this  last 
equation : 
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z 


Of 


Rs(2) 


z- (1-ot)  e 


^EtR(0)  + irflT 


[l-(l-a)e“bT] 


+ tht =Bt (65) 

[z-  (1-ot)  e D1]  [(l-a)e  -1] 

A. 4.  INVERSE  Z TRANSFORM 

The  first  and  last  terms  of  Equations  (64)  and  (65) 
are  not  found  in  the  tables  of  z-transform  so  that  we  will 
proceed  now  to  develop  the  expressions  of  these  z-transforms 
from  a guessed  form  of  f(kT). 

Since  the  first  and  last  terms  are  identical  in  terms 
in  z,  differing  only  by  constant  factors,  we  need  to  do  the 
development  just  for  the  expression  in  z. 

Thus,  let's  assume  that 

f (kT)  = (1-ot)  k e~bkT 


Applying  the  definition  of  z transform  we  have 


F(z)  » l f(kT)z~k  » l (l-a)ke"bkTz-k 
k»0  k=0 


( 66 ) 


-bT  - 1 

Multiplying  both  sides  by  (l-ct)e  z , we  have: 


-bT  -1, 


k+1  -b (k+1) T -(k+1)  (67) 


(l-ct)e  U1j  aF(z)  = v (1-ot) " 'e  z 

ki0 


34 


Subtracting  (67)  from  (66)  side  by  side  we  get 


(l-a-cOe'hWu)  - l (l-a)Ke‘DKTz‘K-  l (1-a)  K+Ae”D'K+A,Tz 

k»0  k=0 


k -bkT  -k  r (1  .k+1  -b(k+l)T  -(k+1) 


[l-(l-a)e-bV1]F(z)  - 1+  l (l-,)k+1e-b(k+1)Tz-(1  + 1) 

k=0 


7 ( 1 — oc ) e 

k*0 


k+1  -b (k+1) T - (k+1) 


Thus 


-hT  - 1 

[l-(l-a)e  z x]F(z)  = 1 


1- (l-a)e 


z- ( 1-a) e 


From  this  it  follows  that 


f (kT) 


z- ( 1-a) e 


, , . k -bkT 

(1-a)  e 


Also, 


Z_1  [- 


z- (1-a)  e 


( 1-a) e -1 


. k -bkT 

a (1-a)  e 


( 1-a) e 


and  we  can  get  similar  expressions  by  changing  the  constant 


part.  From  (52),  (54),  (69)  and  (70)  we  can  now  find 

the  inverse  z-transform  of  equations  (64)  and  (65): 


R(kT)  = (l-a)ke~bkTR(l)  + — — 


-bT 


1- (l-a) e 


+ a(l-a)Vb(k+1)T 

-bT  ( l-a) e-bT-l 


or 


R(kT)  =•  (l-a)ke~bkTR(l)  + ^ 


•bT 


(l-a) e_bT-l 


( (l-a)ke~bkT-l] 


(71) 


And  from  (65) 


Rs(kT)  = (l-a)ke"bkTRo  + — [ ( l-a)  ke“bkT-l]  (72) 

(l-a)e  -1 

These  are  the  equations  (13)  and  (11)  of  Chapter  I,  respec- 
tively, and  constitute  the  solution  of  the  difference 
equations  (57)  and  (59)  in  the  time  domain. 
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APPENDIX  B 


COMPUTER  PROGRAM  DISCUSSION 

In  Chapter  V we  have  shown  that  the  functional  equa- 
tions of  the  dynamic  programming  to  compute  the  optimal 
costs  over  the  set  of  possible  controls  are 

C*N(R(k) ,u(k) ) = Jk,k+1(R(k) 'U(k) )+J£+1>N(R(k+l) ) 


and 


J*  (R(k))  = min  [C*  (R(k) ,u(k) ) ] 

kN  u<k)  kN 

The  program  that  performs  these  computations  is 
listed  in  the  Computer  Program  Section  of  this  thesis  and 
is  composed  of  three  subroutines  and  two  functions.  The 
subroutine  QUANTU  computes  the  discrete  values  of  the  state 
variable  R(k) , and  of  the  inputs  U(k).  For  each  discrete 
value,  the  subroutine  STATE  computes  the  value  of  the  state 
variable  at  the  next  state  and  the  dynamic  equations  of 
our  model  (15)  and  (16)  has  to  be  input  in  this  subroutine. 
With  the  vlaue  of  R(k+1),  the  subroutine  cost  selects  the 
value  of  the  performance  measure  J by  interpolation  between 
the  two  nearest  discrete  values  stored  in  the  array  of 
discrete  values  of  optimal  cost,  COSTOP,  of  the  (k+l)th 
state.  This  is  possible  because  the  computation  is  done 
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backwards  from  the  last  stage  of  operation.  The  costs  of 
the  last  stage  are  computed  by  the  Function  HN,  and  the 
subsequent  cost  for  each  state  and  each  value  of  the  input 
U are  computed  by  the  Function  G.  These  costs  are  summed  by 
the  subroutine  COST  and  in  the  main  program  the  minimum 
value  is  found  for  all  discrete  values  of  U(k).  These  com- 
putations are  repeated  for  all  the  discrete  values  of  the 
state  variable  as  can  be  seen  in  the  flow  chart  of  figure  9. 

The  program  output  presents  the  optimal  costs  and  corres- 
ponding effectiveness  of  rework  a to  go  to  the  final  state 
for  all  discrete  values  of  the  reliability  so  that  starting 
with  a given  initial  reliability  at  the  initial  state  or 
first  rework  table  we  can,  interpolating  through  the  values 
of  the  next  state  until  the  final  state,  find  out  the  optimal 
sequence  of  rework  for  that  particular  initial  condition. 

The  program  output  for  the  examples  of  Chapter  V are 
presented  in  the  Computer  Output  Section  of  this  thesis. 
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